Communication-Avoiding Krylov Subspace Methods in Theory and Practice
نویسندگان
چکیده
Communication-Avoiding Krylov Subspace Methods in Theory and Practice
منابع مشابه
A Residual Replacement Strategy for Improving the Maximum Attainable Accuracy of s-Step Krylov Subspace Methods
Recent results have demonstrated the performance benefits of communicationavoiding Krylov subspace methods, variants which use blocking strategies to perform O(s) computation steps of the algorithm for each communication step. This allows an O(s) reduction in total communication cost, which can lead to significant speedups on modern computer architectures. Despite potential performance benefits...
متن کاملCommunication Avoiding ILU0 Preconditioner
We present a communication avoiding ILU0 preconditioner for solving large systems of linear equations by using iterative Krylov subspace methods. Recent research has focused on communication avoiding Krylov subspace methods based on so called s-step methods. However there is no communication avoiding preconditioner yet, and this represents a serious limitation of these methods. Our precondition...
متن کاملAvoiding Communication in Two-Sided Krylov Subspace Methods
Preconditioning Krylov Subspace Methods are commonly used for solving linear system Standard implementations are communication-bound due to required SpMV and orthogonalization in every iteration Solution: rearrange algorithms to perform s iterations at a time without communicating (s-step methods) SpMV in each iteration is replaced with a call to the Matrix Powers Kernel, which performs...
متن کاملAvoiding communication in primal and dual block coordinate descent methods
Primal and dual block coordinate descent methods are iterative methods for solving regularized and unregularized optimization problems. Distributed-memory parallel implementations of these methods have become popular in analyzing large machine learning datasets. However, existing implementations communicate at every iteration which, on modern data center and supercomputing architectures, often ...
متن کامل